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Description 

FIELD OF THE INVENTION 

[0001 ] The present invention relates to liigh speed da- 
ta communication network systems and, more particu- 
larly, to a bit and word synchronized high speed serial 
switch routing system. 

BACKGROUND OF THE INVENTION 

[0002] Modern, high-speed data communication and 

transmission frequently involves the use of multiple 
transmitters and receivers communicating with one an- 
other, or with multiple memory devices, for example, 
over high-speed data transmission lines. Such high- 
speed data transmission generally imposes stringent re- 
quirements on clock synchronization. Further, high 
speed data communication systems require large 
amounts of data to be sent to various different locations 
or devices comprising a communication network. This 
is typically performed by using networking devices, con- 
ventionally termed switches or routers, which receive 
data from a particular transmitter and reconfigure a sig- 
nal path In order to send the data to a designated recip- 
ient. Conventional switches or routers implement a 
"switch fabric" using integrated circuits to provide a data 
route from a receiving input port to a correct output port 
of the networking device (the switch). The data routes 
often implemented in high-speed switch fabrics are gen- 
erally one bit wide. Thus, for such switches the switch 
fabric routes data over a plurality of serial data paths. 
[0003] l\/lodern high-speed communication systems 
place inordinate demands upon the performance re- 
quirements of the switch of a network switching system. 
The switch must be able to operate at a sufficiently high 
bandwidth such that signal processing is not unduly de- 
layed while data is being transferred. Further, connec- 
tions are frequently being made and broken, such that 
delays often occur while waiting for a connection. In ad- 
dition, the various possible routes through the switch 
fabric from one port to another port are not always of 
equal length. Therefore, signal path lengths, and signal 
delays, change with each reconfiguration of the switch. 
[0004] FIG. 1 illustrates a prior art semi-schematic 
simplified block diagram of a network switching system 
as is e.g. disclosed in US 4 958 341. As illustrated in 
FIG. 1 a crosspoint switch or router circuit is typically 
implemented as a number of integrated circuit compo- 
nents configured on a printed circuit board or card 10. 
The switch need not be a crosspoint switch, delta or oth- 
er switch types may also be used. The switch 1 0 com- 
prises a switch matrix or fabric 1 2 which is reconfigura- 
ble under control of a central processing unit 14 to re- 
ceive data from a switch port circuit 16 and route the 
data to a designated recipient switch port. 
[0005] Data is transmitted to, and received from cor- 
responding switch ports by a multiplicity of transceiver 



circuits 18. The transceiver circuits are configured to 
move data to and from a particular user application 
through transmit and receive FIFOs over parallel inter- 
face busses. Parallel data Is serialized and directed to 

5 a particular switch port over a high-speed serial inter- 
face. Likewise, serial data is received by the transceiver 
1 8 from a corresponding switch port 1 6. The transceiver 
deserializes the serial data and interfaces with a user 
application circuit through a receive FIFO over a parallel 

10 data bus. 

[0006] Each of the transceivers 1 8 typically include a 
clock and data recovery circuit (CDR) 20. The CDR 
locks onto the incoming serial data stream in order to 
recover clock information suitable for controlling the tim- 

15 ing of the various registers comprising the transceiver. 
As noted above, when control signals to the crosspoint 
switch change the switch configuration, the delay 
through the crosspoint also changes. Because of this 
delay change, the CDR must realign itself to the phase 

20 of the new data stream. 

[0007] In addition, prior art-type transceiver circuits 
are typically constructed with their own reference clock 
generator 22. The reference clock generator functions 
as a frequency reference for the CDR 20 such that the 

25 CDR 20 is able to operate in "fly wheel" mode during 
periods when there is no data. Since reference clock 
generators may be frequency mismatched by approxi- 
mately 100 PPM with respect to one another, it is pos- 
sible that a serial bit stream developed by one transceiv- 

30 er and received by a second transceiver is sufficiently 
shifted in phase such that a certain number of bits might 
be lost in each transmitted frame. Moreover, during long 
periods of transmission from one transceiver to another 
data may be lost due to timing drift because the clocks 

35 of various transceivers may be of slightly different fre- 
quencies. This necessitates periodic switch reconfigu- 
ration to force transceiver resynchronization, with prior 
art switches usually having a cell period defining a max- 
imum continuous transmission length. Each time trans- 

40 mission is interrupted to force resynchronization, of 
course, effective switch bandwidth is reduced. Further, 
variations due to transceiver frequency mismatch and 
the changing delay paths through a crosspoint matrix 
are random in direction as well as frequency. Adjusting 

45 a CDR in response to a serial data stream received from 
a first transceiver may result in over-correction, partic- 
ularly if the serial data stream from a next transceiver Is 
jittered in the other direction. 

[0008] In addition, the crosspoint switch delay change 
50 caused by reconfiguration can be larger than one bit 
time, such that word or frame realignment must also be 
performed by the receiving transceiver. Word or frame 
realignment is a generally lengthy process requiring 
many bit times to perform. Thus, a dead period is in- 
55 duced in the data stream which contains no valid data. 
In asynchronous transmission mode switches, for ex- 
ample, this realignment dead period reduces the effec- 
tive bandwidth of a network switching system by approx- 
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imately 10-20%. Moreover, phase recovery circuitry 
must be made as fast as possible to compensate for 
transceiver frequency mismatch and to minimize rea- 
lignment Induced dead time. Conventional systems typ- 
ically use up an additional 1 0-20% of bandwidth in order 
to provide a minimum number of transitions to guaran- 
tee that the serial data stream comprises a sufficiently 
high transition rate to support fast phase recovery cir- 
cuits. 

[0009] Serial data transmission may also be synchro- 
nous. In synchronous data transmission the sequence 
of binary "ones" and "zeros", making up the data stream, 
occurs with reference to a data bit cell defined by a uni- 
form or single-frequency clock signal transmitted with 
the data. Transmitting the clock signal together with the 
data, however takes up valuable bandwidth, increases 
high speed line requirements, and reduces the data 
transmission capability of the system. In addition, word 
alignment must still be performed. 
[0010] The effects of jitter, or bit shift, in a serial data 
stream are illustrated in FIG. 2. Data has been phase- 
locked to a bit clock signal wherein data Is stable within 
a particular bit period such that it may be strobed into 
an input register on the falling edge of bit clock. Given 
perfect phase and frequency lock, the periodicity of the 
bit clock signal might serve to define synchronous bit 
cells; a logical high data occurring within a code bit cell 
representing a logic ONE, a logical zero on data occur- 
ring within a code bit cell representing a logic zero. The 
data sequence Illustrated would therefore be read as 
11011000. 

[001 1] Phase jitter, frequency mismatch, andior a de- 
lay change through the switch matrix, has displaced, or 
shifted, the serial data stream by approximately 90 de- 
grees in phase. Data stability, of the late data stream, 
occurs outside of the intended code bit cell, and into the 
next code bit cell, causing the data stream sequence to 
be incorrectly read as 01101100 rather than 11011000. 
Thus, it can be seen that by merely shifting a particular 
serial data stream by approximately 90 degrees in 
phase, the binary sequence comprising a data word, as 
represented within a frame defined by a word clock sig- 
nal, causes the word to lose all meaning. 
[0012] The random nature of data shift can be appre- 
ciated by referring to FIG. 3. Shifts in the nominal posi- 
tion of a data transition edge due to timing fluctuations 
result in a normal distribution of possible transition edg- 
es distributed with respect to time around the occur- 
rence of the bit clock timing edge. If the bit clock period 
is used to define the code bit cell boundaries, there 
would be an approximately 50% probability that a tran- 
sition edge, representing a transition from 1 to 0, or 0 to 
1 , would be shifted early or late and therefore not cap- 
tured In the proper code bit cell, giving rise to a data 
word error. A code bit cell should properly have its 
boundaries symmetric about the mean of an expected 
data value. However, because of a multiplicity of refer- 
ence clock signals provided in prior art-type transmis- 



sion systems, bit cell boundaries must be inordinately 
wide in order to accommodate the expected transition 
edge distribution pattern. Widening the bit period nec- 
essarily requires that a system bandwidth be conse- 

5 quently reduced, reflecting a loss of transmission capa- 
bility. Accordingly, some other means must be provided 
to ensure that all of the component elements of a multi- 
port transmission system be at least frequency locked 
together, such that only phase recovery Is necessary to 

10 correctly place the transition edges of a serial data 
stream within an appropriate code cell boundary. 
[0013] The same reasoning holds true for word syn- 
chronizing a 2.125 GHz serial data stream. A word de- 
tection window (word clock) must be able to accommo- 

15 date variations In its own frequency and phase in order 
to provide for accurate detection and capture of a data 
word from serial data running at sllg htly variable channel 
rates. If a word clock signal were to be bit-shifted by the 
same approximately 90 degrees in phase from the bit 

20 clock signal, the same type of data read error would oc- 
cur as if the bit clock signal were shifted. Thus, it will be 
understood that in addition to having each of its compo- 
nent elements frequency-locked together, an effective 
high-speed data transmission system must also provide 

25 for a word clock signal which Is frequency-locked to a 
bit clock. Moreover, the word clock signal must accu- 
rately define the beginning of a data word and, thus, 
must be consistent across all of the component ele- 
ments of such a transmission system. 

30 [0014] In addition, many prior art switches utilize a 
processing unit to determine a switch configuration and 
provide flow control signals for controlling the flow of in- 
formation through the switch. The processing unit re- 
ceives connection requests and transceiver status slg- 

35 nals over a common data bus accessed by all transceiv- 
ers connected to the switch. Thus, at any given time, 
transceivers are requesting access to the common data 
bus to place connection requests and to provide trans- 
ceiver status signals, such as signals indicating that the 

40 transceiver is unable to accept additional data due to 
the transceivers input buffer being full. 
[001 5] The use of a common data bus and processor 
receiving information from a plurality of transceivers 
over the data bus may result in delays in data commu- 

45 nications. That is, the data bus may not be accessible 
at any given instance due to the data bus already being 
in use by another transceiver. Accordingly, the system 
design must take into account delays due to use of a 
common data bus in determining when to transmit trans- 

50 celver Input buffer full status, and other signals, and ad- 
ditionally switch connections may be delayed due to de- 
lays in providing the processing unit the connection re- 
quests. Thus, the use of a processing unit and common 
data bus further decreases the bandwidth of the switch. 

55 

SUMMARY OF THE INVENTION 

[0016] The present invention therefore provides a 
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high speed network switching apparatus, comprising a 
switch including a plurality of switch ports, each switch 
port defining a transmission channel and adapted to 
transmit and receive a high-speed serial data stream. 
Further a switch fabric coupled to the plurality of switch 
ports, the switch fabric routing data among and between 
the switch ports and a plurality of transceiver circuits, 
each transceiver circuit configured to transmit and re- 
ceive a high speed serial data stream between a corre- 
sponding one of the plurality of switch ports so as to es- 
tablish a transmission channel between a correspond- 
ing transmitting transceiver circuit and a corresponding 
receiving transceiver circuit. The data stream includes 
command and data words comprising a data portion and 
a header portion, wherein the header portion includes 
overhead bits configured to provide a ready-to-receive 
indication from a receiving transceiver circuit to a trans- 
mitting transceiver circuit when the overhead bits are in 
a first binary sequence, a not-ready-to-receive indica- 
tion from a receiving transceiver to a transmitting trans- 
ceiver when the overhead bits are in a second binary 
sequence, the switch adaptively routing the overhead 
bits from the corresponding receiving transceiver circuit 
to the corresponding transmitting receiver circuit. 

DESCRIPTION OF THE DRAWINGS 

[0017] These and other features, aspects and advan- 
tages of the present invention will be more fully under- 
stood when considered with regard to the following de- 
tailed description, appended claims and accompanying 
drawings wherein: 

FIG. 1 is a semi-schematic block diagram of a prior 

art crosspoint switch and transceiver; 

FIG. 2 illustrates a series of waveform diagrams 

showing the effects of timing error on a serial data 

stream; 

FIG. 3 illustrates the random nature of bit displace- 
ment and its effects on word alignment; 
FIG. 4 is a semi-schematic block diagram of an ex- 
ample of a multiplicity of high speed serial transceiv- 
er ports coupled to a cross-switch routing circuit of 
the present invention; 

FIG. 5a is a semi-schematic block diagram of the 
transceiver circuit of FIG. 4 incorporating circuitry 
for bit and word synchronization; 
FIG. 5b is a semi-schematic block diagram of the 
switch circuit of FIG. 4 incorporating circuitry for de- 
veloping a global clock domain for bit and word syn- 
chronization; 

FIG. 6 is a flow diagram illustrating a word synchro- 
nization process of the present invention; 
FIG. 7 illustrates command and data word formats 
for illustrating 34-bit transmission characters includ- 
ing two overhead bits for providing self-routing and 
low level flow control of the present invention; and 
FIG. 8 is a semi-schematic block level diagram il- 



lustrating the use of overhead bits to accomplish 
low level flow control in a multi-transceiver imple- 
mentation of the present invention. 

5 DETAILED DESCRIPTION 

[0018] FIG. 4 illustrates a semi-schematic block dia- 
gram of a packet-based switching system of the present 
invention. The system includes a 16 X 16 synchronous 

10 serial crosspoint switch circuit 50. Up to 16 high speed 
serial transceiver port cards 52 (only four of which are 
shown) are connected to the crosspoint switch circuit by 
pairs of suitable transmission lines 57a, b. In the em- 
bodiment described the crosspoint switch circuit oper- 

15 ates at an aggregate bandwidth of up to approximately 
32Gb/s. The crosspoint switch circuit unit 50 includes a 
conventional 16X16 crosspoint switch fabric 53 config- 
ured to provide sixteen connections from one side of the 
switch fabric to another side of the switch fabric on a 

20 selective basis. The fabric 53 is connected to receive 
serial data from, and send serial data to, 1 6 bi-direction- 
al switch ports, commonly indicated at 54. Each of the 
switch ports are in turn connected to transmit and re- 
ceive serial data from a corresponding one of the port 

25 cards 52 over the transmission lines at a serial data rate 
of about 2. 1 25 GHz. For purposes of clarity and for ease 
of explanation, only four of bi-directional switch ports 54 
are shown in the example of FIG. 4, but those having 
skill in the art will recognize how to expand the repre- 

30 sentations of both the switch ports 54 and the transceiv- 
er port cards 52 so as to accommodate a 1 6 X 1 6 switch 
fabric. Implementations of crosspoint switch matrixes or 
fabrics are well known in the art, and therefore the switch 
matrix or fabric 53 crosspoint switch (or cross-switch 

35 router) requires no further elaboration herein. It is suffi- 
cient to mention that the switch matrix or fabric is a 16 
X 16 matrix which receives incoming serial data from a 
selected one of the port cards 52 and routes the serial 
data to an appropriate recipient port card, designated 

40 as the addressee in a data packet header at the incom- 
ing serial data. Further, other switches, such as a Delta 
switch, may be used in place of the crosspoint switch of 
the example of FIG. 4. 

[0019] An arbitration logic and switch control circuit 
45 55 determines the configuration of the crosspoint switch 
fabric 53. The switch control circuit communicates with 
logic circuitry 56 incorporated into each of the switch 
ports 54 in order to ensure that the data received from 
the transmitter is directed to a correct designated recip- 
50 ient. The switch control circuit implements a round robin 
arbitration scheme for allocating switch connection re- 
quests. Circuits for implementing round robin arbitration 
schemes are known in the art. Alternatively, the arbitra- 
tion logic and switch control circuit could maintain a 
55 record of all switching and routing transactions in a port 
connection table, and thereby identify sender/recipient 
pairs and keep track of available connections through 
the switch fabric. 
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[0020] As will be developed more fully below, routing, 
or connection, requests (CRQs) are made by a trans- 
mitting port to the arbitration logic and switch control cir- 
cuit 55, which appropriately configures the matrix 53. 
The logic circuity 56 additionally provides the switch 
control circuit connection requests overhead bits to ef- 
fect flow control of data transmitted through the switch. 
[0021] A global, system wide clock signal is provided 
on the switch circuit unit 50 and defines a global word 
clock (WCLK) signal, which is a 62.5 MHz signal in the 
described example. A synchronized bit clock timing sig- 
nal is developed through a CMU circuit 58 using the 
word clock signal, with the bit clock timing signal being 
a 2.125 GHz signal in the described example. The 
WCLK signal is provided by an external 62.5 IVIHz crys- 
tal oscillator, which is coupled to the switch circuit in con- 
ventional fashion, but some other suitable reference 
clock generation circuit may also be used. The bit clock 
timing signal is directed, globally, to each of the bi-direc- 
tional switch ports 54 comprising the switch circuit unit 
50. Defining the bit clock timing signal for each of the 
switch ports from a single input reference clock signal 
(WCLK) has important implications to the synchronous 
bi-directional data transmission characteristics of the 
system. Since each of the switch ports operate off of a 
unitary timing signal developed from a single timing ref- 
erence, it will be understood that each of the switch ports 
54 will operate in a synchronous, albeit possibly phase 
shifted, fashion with the others. 

[0022] Each switch port 54 comprises a receiver sec- 
tion including a serial-to-parallel data converter 60 (also 
referred to as a deserializer or DMUX). The DMUX is 
configured to receive a serial data stream transmission 
from the transmitter section of a corresponding trans- 
ceiver port card 52 and convert the serial data into a 
parallel data word (referred to herein as a transmission 
character). In the example described, the serial-to-par- 
allel converter 60 receives incoming data transmissions 
at a 2. 1 25 Gb/s data rate and outputs a 34-bit transmis- 
sion character comprising a 32-bit data word, plus two 
overhead bits, at a parallel data rate of about 62.5 MHz. 
[0023] Similarly, each switch port 54 comprises a 
transmitter section including parallel-to-serial data con- 
verter 62 (also referred to as a serializer or MUX) which 
performs a similar function to the serializer 60, but in 
reverse. The parallel-to-serial converter 62 receives a 
34-bit transmission character (a 32-bit data word, plus 
two overhead bits) which has been routed to the corre- 
sponding switch port through the switch fabric 53 at an 
input parallel data rate of approximately 62.5 MHz. The 
parallel-to-serial converter converts the parallel data in- 
to a serial data stream suitable for transmission to a re- 
ceiver portion of the port card 52 at a serial data rate of 
approximately 2.125 Gb/s. Thus, the 62.5 MHz WCLK 
signal, distributed by the CMU clock circuit 58, is used 
as a master strobe to clock 34-bit parallel data out of the 
serial-to-parallel converter 60 to the port logic circuit 56. 
The WCLK signal is also used to clock 34-bit parallel 



data from the port logic circuit 56 into the parallel to se- 
rial converter 62. All timing signals, whether serial bit 
timing signals or parallel word timing signals, used by 
each of the switch ports, therefore, is developed by the 
5 CMU clock circuit 58 in response to the system wide ref- 
erence WCLK. 

[0024] Each of the transceiver port cards 52 are typi- 
cally constructed to include a mix or combination of 
transceiver circuitry and circuitry related to a particular 

10 user's application. In a typical configuration, a transceiv- 
er port card includes physical layer circuitry 61 , 63 for a 
given communication protocol, and data buffer circuitry 
that manages the information flow and formatting be- 
tween downstream user application circuitry and the 

^5 transceiver. In the example of FIG. 4, the data buffer cir- 
cuitry comprises transmit and receive FIFOs 64 and 66, 
respectively. The transmit and receive FIFOs are each 
coupled to the transceiver circuitry over a parallel data 
interface. In the example described, data is clocked to 

20 the transceiver at the 62.5 Mb/s parallel data rate. 
[0025] In many communications applications, howev- 
er, the parallel data interface to the transmit and receive 
Fl FOs will operate at a different frequency than the 62.5 
MHz word clock used by the switch card and the trans- 

25 ceiver port card's transmit and receive circuitry. In this 
case, the transmit and receive FIFOs 64 and 66 are im- 
plemented as synchronous, dual port FIFOs, whose du- 
al clock ports are used to elastically span any discontin- 
uous clock boundaries between the transmission side 

30 and the media side. In addition, the transmit and receive 
FIFOs are made large enough to function as data 
queues or data buffers for each port card's transceiver 
circuitry. The transmit and receive FIFOs may be imple- 
mented as register stacks, string buffers, and the like, 

35 but are preferably implemented as dual-port, parallel da- 
ta buffer, integrated circuit memory elements. Suitable 
transmit and receive FIFOs 64 and 66 include FIFO de- 
vices able to operate at speeds up to 67 MHz. Such a 
FIFO is exemplified by the IDT7236 series of synchro- 

40 nous FIFOs, manufactured and sold by Integrated De- 
vice Technology, among others. 
[0026] Each transceiver port circuity 68 comprises a 
transmitter section, indicated as TX, and a receiver sec- 
tion, indicated as RX. The transmitter section includes 

45 a serializer (not shown in the example of FIG. 4) for con- 
verting 62.5 Mb/s parallel data from the transmit FIFO 
64 into a serial data stream suitable for transmission to 
the receiversection of a corresponding switch port. Like- 
wise, the receiver section incorporates a serial-to-par- 

50 allel converter (also not shown) for converting a high 
speed serial data stream, from the transmitter section 
of the corresponding switch port, into 62.5 MHz parallel 
data suitable for receipt and storage by the receive Fl FO 
66. The serial interconnect between a transceiver port 

55 circuitry 68 and the corresponding switch port of switch 
circuit card 60 is a bi-directional serial interface and op- 
erates to transmit and receive high-speed, serial data 
signals at 2. 1 25 Gb/s. In a manner that will be described 
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in greater detail below, the serial data streams commu- 
nicated between a transceiver port and a switch port, 
and the parallel data communicated between a trans- 
ceiver port circuitry 68 and its associated FIFOs 64 and 
66, are bit and word synchronized to the bit and word 
timing signals used to strobe serial and parallel data by 
the timing elements of the switch card 50. 
[0027] The transceiver bit clock (i.e., the timing sig- 
nals used to define the bit or cell period of serial data) 
is recovered from an incoming serial data stream pro- 
vided to the transceiver port's receiver section by the 
switch port 54. Recovered bit clock strobe transitions 
are also used to clock an outgoing serial data stream 
from the transmitter to a corresponding switch port 54. 
Accordingly, the serial data stream provided to the 
switch port 54 by the transceiver 68 will be at the same 
frequency as the bit clock of the switch port, and need 
only have its phase evaluated in order to ensure proper 
bit phase alignment because the switch card 50 defines 
the timing parameters of a serial data stream directed 
to the transceiver port circuitry 68. 
[0028] Referring now to FIGS. 5a and 5b, there is 
shown a semi-schematic block diagram of an embodi- 
ment of a transceiver port circuitry 68 coupled to a cor- 
responding switch port 54 of a switch card over a bi- 
directional 2.125 Gb/s differential serial data link. The 
transceiver circuit is illustrated in FIG. 5a, while the cor- 
responding switch port and switch unit circuitry is illus- 
trated in FIG. 5b. As is the case with the example illus- 
trated in FIG. 4, the transceiver port circuitry 68 is con- 
nected to transmit and receive Fl FOs, 64 and 66 respec- 
tively, over 62.5 MHz parallel data interface busses 
adapted to communicate parallel data between the 
transceiver port circuitry 68 and the FIFOs. The data in- 
terface connection from the transmit FIFO 64 comprises 
a 32-bit parallel transmission data bus TXIN[31:0], 
which is clocked into the transceiver on a transition edge 
of the transceiver master word clock timing signal 
WCLK. As will be later discussed, the transceiver devel- 
ops two word clocks, a transceiver transmit word clock 
and a transceiver receive word clock. In order to in- 
crease the ease of interfacing with the transceiver, the 
transceiver transmit word clock is designated as the 
transceiver master word clock. 

[0029] A 2-bit transmission type signal TXTYP[1 :0] is 
also provided on the parallel interface and, if the trans- 
ceiver is put into a first configuration, defines the type 
of data word being transmitted. On the other hand, as 
will be described below, if the transceiver is put into a 
second configuration, the TXTYP[1:0] signals directly 
control the configuration of two overhead bits appended 
to a command or data word in the MSB positions. The 
two overhead bits function to define flow control signals 
in the second configuration. 

[0030] The data interface connection between the 
transceiver and the receive FIFO 66 is a 32-bit parallel 
receive data bus RXOUT[31 :0]. The receive data bus is 
clocked out of the transceiver on a transition edge of the 



transceiver master WCLK timing signal. A two bit re- 
ceive word type signal RXTYP[1 :0] is also provided on 
the parallel interface. The receive word type signal de- 
fines the type of data word being received if the trans- 
5 ceiver is put into the first configuration. If the transceiver 
is put into a second configuration, however, the RXTYP 
[1 :0] signal reflects the configuration of two overhead 
bits appended to a command or data word and received 
over the serial channel of the transceiver. 
10 [0031 ] In addition to these parallel signal busses, both 
the transmit FIFO 64 and receive FIFO 66 host numer- 
ous command and control signals, several of which are 
coupled to the transceiver circuit and several of which 
are coupled to application control circuitry (63 of FIG. 
15 4). Those having skill in the art will easily recognize how 
to make suitable configuration connections between the 
transceiver and a respective FIFO. Therefore, it is not 
considered necessary to give a detailed description of 
each and every signal connection herein. 
20 [0032] Two signal connections, however, should be 
described in order to gain a more complete understand- 
ing of the construction and operation of the transceiver 
port circuitry 68. An almost full indication signal AF is 
conventionally asserted by the receive FIFO 66 when 
25 the number of empty memory locations is less than, or 
equal to, a pre-programmed value. Such a condition oc- 
curs if data is being written to the FIFO at a rate faster 
than the FIFO is being read at the media side. Likewise, 
a read enable signal REN is conventionally asserted to 
30 the transmit FIFO 64, and indicates that a receiving de- 
vice is ready to receive data. In the embodiment of FIGS. 
5a and 5b, the AF and REN signals are coupled to the 
transceiver, with the transceiver receiving AF from the 
receive FIFO and asserting REN to the transmit FIFO. 
35 The transceiver utilizes the AF and REN signals in con- 
figuring two overhead bits appended to data words 
transmitted to the switch. The two overhead bits are 
used to indicate, among other items, whether the port 
card receive FIFO buffer has sufficient available space 
40 to receive additional data. The overhead bits, therefore, 
are routed from a receiving transceiver to a transmitting 
receiver through a reverse crosspoint switch implement- 
ed on the switch, in a manner more fully later described. 
[0033] Referring now to FIG. 5b, the switch port 54 is 
45 connected to a switch matrix or fabric 53. The switch 
fabric is adapted to route data transmissions, received 
from a particular transceiver port, to a designated switch 
port and thence to its corresponding intended recipient 
transceiver port This is done under the operational con- 
50 trol of an arbitration logic and switch control circuit 55. 
As referred to previously in the example of FIG. 4, the 
switch matrix or fabric 53 is conventional in implemen- 
tation and design, and need not be further described 
herein. It should be noted, however, that unlike conven- 
es tional switches implementing a switch fabric, the arbi- 
tration logic and switch control circuitry 55 is not imple- 
mented as a conventional central control processor. 
However, a control processor may be used with various 
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aspects of the present invention. 
[0034] Further, flow control decisions are not delayed 
by using data provided by the transceivers and routed 
to a conventional central control processor using a ded- 
icated data bus. Instead, overhead bits are sent through 
essentially a reverse crosspoint switch and appended 
to the 32-bit data packet (thereby defining a 34-bit trans- 
mission character) and used to directly control the flow 
of information from a transmitter to a receiver, as well 
as provide other information. 

[0035] Turning now to the transceiver port circuitry 68 
of FIG. 5a, the transceiver can be viewed as comprising 
two parts, a transmitter section and a receiver section. 
When the transceiver is in transmit mode, a 32-bit data 
word TXIN[31 :0] and a 2-bit transmission type word TX- 
TYP[1 :0], are clocked out of the transmit FIFO 64 and 
into a synchronizing parallel input buffer register 70 in 
accord with 62.5 MHz clock rate. 
[0036] Parallel data is clocked out of the buffer regis- 
ter 70 and into a transmit control logic circuit 71 . Trans- 
mit control logic circuit 71 is responsible for asserting 
transmission state signals to the transmit FIFO. Such 
state signals include indications that data packets have 
been successfully transmitted to all outputs, a begin- 
ning-of-packet indication, a retransmission required in- 
dication, and the like. Also, transmit control logic 71 is 
responsible for adaptively reconfiguring TXTYP[1 :0] in- 
formation into a 2-bit flow control overhead bit field when 
the transceiver is configured to operate in a particular 
communication mode, designated "overhead-mode" 
herein. An overhead-mode signal, OH-MODE, is a user 
programmable state signal, externally sourced, and 
coupled to the transmit control logic circuitry 71 over an 
internal communication bus 75. 

[0037] In any communication mode, the transmit con- 
trol logic 71 combines the 32-bit data TXIN[31:0] with 
either the 2-bit TXTTYP[1 :0] or a 2-bit flow control over- 
head bit field, into a 34-bit data string, the 34-bit data 
string comprises a transmission word or transmission 
character. The 34-bit wide transmission characters are 
serialized by a parallel-to-serial converter 72 (also re- 
ferred to as a serializer or MUX) and provided to a 2. 1 25 
GHz serial output buffer 74. Serialized data is clocked 
out of the transceiver 68 as a differential signal TXS+/ 
TXS- over a high speed serial transmission line to the 
input of a corresponding switch port 54. The serial out- 
put buffer 74 is clocked by a 2.125 GHz bit clock signal 
which is, in turn, directly developed by the CPU from an 
incoming serial data stream sent by the switch port 54. 
The bit clock signal, BCLK, is a 2. 1 25 GHz strobe which 
defines the bit cell boundaries of the desired serial data 
stream. The BCLK signal is directed through a timing 
generator 86 which comprises divide-by-34 circuitry, 
such that the 2.125 GHz BCLK signal is divided down 
to the 62.5 MHz transceiver transmit word clock signal, 
which is also the transceiver master word clock WCLK 
signal, in synchronous fashion. Thus, it will be under- 
stood that the word boundaries of WCLK and, thus, each 



34-bit wide transmission character, will correspond to 
and be synchronous with every 34th strobe transition 
edge of the BCLK signal. 

[0038] On the receiver side, a high speed serial trans- 

5 mission line is coupled between a high speed output of 
the switch port 54 and the receiver input of the trans- 
ceiver circuit 68. The transmission line is configured to 
provide a differential, serial data stream RXS+/RXS- to 
the transceiver 68 at a 2. 1 25 Gb/s data rate. The receiv- 
er input is coupled to a deserializer, or serial-to-parallel 
converter 78 which suitably converts the 2.1 25 GHz se- 
rial data stream into 62.5 MHz 34-bit wide parallel trans- 
mission characters. 

[0039] Serial data is transmitted by the switch port 54 
for retrieval by the transceiver circuit 68 without any ad- 
ditional timing reference signals added thereto. A serial 
stream of data flows over the transmission line with no 
accompanying clock information. However, the deseri- 
alizer 78 must process the serial data stream synchro- 
nously, such that the resulting 34-bit wide parallel trans- 
mission characters are correctly aligned on the appro- 
priate word boundaries. Thus, timing information, i.e., a 
clock signal, is recovered directly from the serial data 
stream by a clock recovery unit (CRU) 80. The CRU 80 
is a phase and frequency sensitive clock recovery cir- 
cuit, such as a high-speed phase locked loop (PLL). PLL 
circuitry suitable for extracting a 2. 1 25 GHz BCLK signal 
from a 2. 1 25 Gb/s data stream are common circuits im- 
plemented in high speed transceiver applications and 
are well understood by those having skill in the art. Ac- 
cordingly, it is considered unnecessary to go into detail 
regarding their construction and operation herein. It is 
sufficient that CRU 80 is able to recover a bit clock signal 
BCLK from a serial data stream provided by the switch 
port 54, and that the recovered BCLK signal is frequen- 
cy-locked to the frequency of the serial data stream 
transmitted by the switch port. 

[0040] The recovered clock signal, BCLK, is directed 

through a divide-by-34 timing generator 82 which pro- 
vides a 62.5 MHz transceiver receive word clock signal 
to the deserializer 78 and input side of retiming bank 79. 
The output side of the retiming bank receives the trans- 
ceiver master word clock signal WCLK, as do receive 
control logic circuitry 83, a parallel output buffer register 
84 and a receiver FIFO 66, from whence received trans- 
mission characters are directed to follow-on customer 
application circuitry over a parallel data interconnect 
bus. It should be noted that the 62.5 MHz WCLK signal 
provided to the receive control logic 83, the parallel out- 
put buffer 84 and the receiver FIFO 66 is in phase and 
frequency alignment with the WCLK signal directed to 
the serializer 72, the parallel input buffer 70 and the 
transmit FIFO 64, since all of these timing signals derive 
from the same source, i.e., the timing information recov- 
ered from a serial data stream by the CRU 80. In addi- 
tion, both the transceiver receive and transmit word 
clock signals are the same frequency as word clock the 
bit clock signals (BCLK), developed by the CRU 80, and 
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the incoming serial data stream transmitted by tine 
switch port 54. Because of this relationship between all 
of the timing signals developed in both the switch port 
54 and a corresponding transceiver 68, as well as the 
bi-directional data transmissions, it will be understood 
that the switch circuit 50, its composite switch ports 54, 
and all of their associated transceiver circuits, are fre- 
quency-locked to a single clocl< source, which is devel- 
oped by a local CMU 89 on the switch card 50, in oper- 
ational response to a single external timing reference 
signal. 

[0041] Turning now to the switch port 54 illustrated in 

FIG. 5b, differential, high speed serial data is received 
from the transceiver's serial output buffer 74 (shown in 
FIG. 5a) and provided to a data recovery unit (DRU) 86. 
Because the serial data stream has been clocked out of 
the transceiver by a BCLK signal which is frequency- 
locked to the global system clock, the DRU 86 need only 
be implemented to evaluate the phase of the incoming 
serial data stream. Frequency lock is maintained by run- 
ning the DRU 86 off of a BCLK signal directed to the 
DRU by the CMU 58 which is suitably constructed to 
multiply a global input, 62.5 MHz WCLK signal by a fac- 
tor of 34, in order to define a 2.125 GHz BCLK signal 
suitable for bit clocking operations. The local CMU 58 
assists the DRU 86 in obtaining and maintaining fre- 
quency lock, such that the DRU need only phase lock 
to the incoming serial data stream. 
[0042] Phase-locked serial data is provided by the 
DRU 86 to the deserializer 60 which converts the serial 
data stream into a 34-bit wide parallel transmission 
character suitable for processing by port logic circuitry 
56. The 34-bit wide parallel transmission character is 
processed by the port logic circuitry 56 in order to de- 
termine the intended recipient of the data packet and 
appropriate switch configuration and connection re- 
quests are fonwarded to the arbitration logic and switch 
control circuitry 55, requesting that the switch fabric 53 
be configured appropriately. Data traversing the switch 
fabric 53 towards an intended recipient, is directed into 
the port logic circuit 56 of the appropriate recipient 
switch port. Port logic circuitry transfers the 34-bit wide 
parallel transmission character to the serializer 62 which 
converts the 62.5 MHz parallel signal into a 2.125 Gb/s 
serial data stream which is, in turn, clocked out of the 
switch port through a serial output buffer 94. 
[0043] It will be seen from FIG. 5b, that timing infor- 
mation for both the serializer 62 and deserializer 60 is 
developed through respective timing generators 96 and 
98, each responsive to the 2.125 GHz BCLK signal de- 
veloped by the CMU 58. In addition, the serial output 
buffer 94 clocks the serial data onto the transmission 
line and, thence, to the receiver input of the transceiver 
port circuitry 68 (shown in FIG. 5a), in accordance with 
a BCLK timing strobe. Thus, it will be seen that the out- 
put timing of the serial data stream is defined by a bit 
clock signal (BCLK) developed by the CMU 58 from a 
master system clock signal (WCLK). This same bit clock 



signal (BCLK) is used to frequency-lock the switch port's 
data recovery unit 86 to an incoming data stream. 
Therefore the switch port's inputs and outputs are 
strobed at identical frequencies and the timing bounda- 

5 ries of data received and transmitted are separated only 
by a transmission line length induced phase shift. Sim- 
ilarly, the BCLK signal which defines the serial data 
stream frequency is recovered by the clock recovery unit 
80 of the transceiver port circuitry 68. The rearward sig- 

10 nal is used to define an analog BCLK signal, identical in 
frequency to the switch port's BCLK frequency, and 
which is used to strobe the transceiver's serial output 
buffer 74, thereby defining the frequency of the serial 
data stream directed to the switch port 54. 

15 [0044] In other words, the embodiment of FIGS. 5a 
and 5b can be viewed in terms of a transmit/receive 
clock feedback loop, with the switch port 54 defining a 
bit cell or bit period clock (BCLK) and using BCLK to 
define the frequency of a serial data stream directed to 

20 a transceiver. The transceiver, in turn, recovers BCLK 
from the incoming serial data stream and uses this re- 
covered clock to serialize and transmit its serial data 
streams directed to the switch port 54. Therefore, the 
serial data stream directed to the input of the switch port 

25 is necessarily at the same frequency as the switch port's 
bit clock (BCLK) and need only be phase-adjusted to 
accommodate any transmission line length induced 
phase shift. The present system only requires the serial 
data streams are encoded to ensure an approximate 

30 15% edge transition density. Moreover, the overhead 
bits further provide, during much of normal transmission 
periods, additional edge transitions and thereby in- 
crease edge transition density. So long as the serial data 
stream has the appropriate edge transition density, the 

35 system comprising the master system clock (WCLK), in 
combination with the switch port's CMU 58 and DRU 86, 
provide a means for ensuring frequency lock and bit 
alignment between and among a multiplicity of switch 
ports 54 coupled to a corresponding multiplicity of trans- 

40 ceivers 52. This is without regard to variable delays de- 
veloped through the switch fabric 53 as the fabric chang- 
es its switch configuration in response to routing re- 
quests, and without the need for a transceiver 68 to burn 
valuable bandwidth realigning itself to the phase of a 

45 new incoming serial data stream. 

[0045] Notwithstanding the inherent bit alignment 
characteristics of the system according to the present 
invention, it is nevertheless necessary to also provide 
for some means to word synchronize the information 

50 communicated between transceiver 52 and the switch 
port 54. Even though the transceiver 52 and switch port 
54 are frequency-locked together, the transmit and re- 
ceive data streams may be out of word alignment, with 
resultant loss of transmission character content Ac- 

55 cordingly, word (or frame) alignment must be estab- 
lished and maintained throughout serial data transmis- 
sion. To recover word timing, the switch circuit 50 issues 
particular, pre-defined alignment words to each of the 
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transceivers 68 during transmission link initialization 
and handsliake protocol establishment. 
[0046] Referring now to FIGS. 5a and 5b, and the flow 
charts of a word alignment and synchronization process 
illustrated in FIG. 6a, word timing synchronization is es- 
tablished between a switch port and its associated 
transceiver port by an adaptive feed-back process. In 
the adaptive feed-back process a predefined alignment 
word transmitted by the switch are used by the trans- 
ceivers to establish a transmitter receive word clock. 
The transceiver then transmits alignment words to the 
switch, with the switch then comparing the alignment 
word to an expected alignment word. The switch con- 
tinues to issue alignment words in the event that the 
alignment word does not match with the transceiver 
shifting its transmitted alignment word in bit-by-bit fash- 
ion until the transceiver is word synchronized to the 
switch. 

[0047] A flow chart of the word alignment process is 
illustrated in FIG. 6A. The word alignment process oc- 
curs upon power up, reset, or link initialization. The word 
alignment process executes independently for each 
transceiver. The word alignment process, therefore, 
may execute in parallel for any number of transceivers. 
In step 1 00 of the word alignment process, the transceiv- 
er transmits at least one reset word to the switch. The 
reset word, comprising all logic "ones" in the described 
example, requests that the switch begin the initialization 
and word synchronization process. The receipt of a re- 
set word by the switch causes the switch to transmit 
alignment words to the transceiver. Alignment words are 
generated in Step 120 by an alignment word generator 
and comparator 1 00 comprising a portion of the port log- 
ic circuitry 56. In the example presently described, upon 
receipt of the reset word, the port logic circuitry 90 caus- 
es the alignment word generator and comparator circuit 
100 to sequentially generally output alignment words 
through the serializer 92 and serial output buffer 94. The 
alignment words are transmitted to the receiver input of 
the corresponding transceiver port circuitry 68. Align- 
ment words include no inherent data content and so may 
be devised to contain any form of binary information. 
Preferably, alignment words are encoded such that the 
word (frame) boundaries can be easily determined by 
the alignment word generator and comparator circuit 
100. Such an encoding scheme may be implemented in 
an alignment word comprising a "1" in the LSB and MSB 
positions of the word, with the remaining bit cells com- 
prising a "0" string, i.e., 10000001, using an 8-bit word 
as an example. Other bit patterns with increased edge 
density, such as 1 01 01 01 1 , may also be used. 
[0048] In step 1 01 the process determines if the trans- 
ceiver detects the alignment word. The transceiver cir- 
cuitry which accomplishes this deserializes alignment 
words using the deserializer 78 and uses an alignment 
detector circuit 102, coupled to "snoop" the parallel bus 
coupled between the deserializer 78 and the transceiv- 
er's retiming register bank. 



[0049] If the alignment detector does not detect the 
correct alignment word the alignment detector provides 
a signal to the receive word clock timing generator to 
shift the receive word clock by one bit in step 102. Ex- 

5 amination of the received alignment words and, if nec- 
essary, the shifting of the receive word clock continues 
until the alignment detector detects the correct align- 
ment word. Once the receive word clock is correctly 
aligned, the transceiver begins transmitting alignment 

10 words to the switch in step 103. The switch, using the 
alignment word generator and comparator circuit 100 
compares the received alignment words to the expected 
alignment word in step 1 04. If the switch detects the cor- 
rect alignment word the switch in step 1 07 issues IDLE 

^5 word to the transceiver to signal that the transmitter is 
now word synchronized with the switch. The process 
then returns. 

[0050] If the transceiver continues to receive align- 
ment words, the alignment detection circuit 1 02 causes 

20 the frame generator and bit shifter to shift its transmit 
word boundary by one bit position after receipt of every 
32 alignment words from the switch in steps 105 and 
1 06. The process repeats until the alignment word gen- 
erator and comparator circuit 100 in the switch deter- 

25 mines that the alignment words sent by the transceiver 
are correctly framed in accordance with the switch word 
clock signal. 

[0051] Bit and word alignment is accomplished only 
during link initialization. Since this process occurs rela- 
te tively infrequently, the system of the present invention 
is not required to support fast phase acquisition and 
need only maintain frequency lock in the manner de- 
scribed above. Moreover, any small variation in phase 
of the signal received by the switch, whether due to com- 
35 ponent aging or temperature variations, is accounted for 
by the data recovery unit (DRU) of the switch circuitry. 
In addition, since a master reference clock is provided 
on the switch circuit, the system does not require trans- 
mission characters to incorporate additional overhead 
40 bits devised to absorb the types of bit loss that can occur 
with multiple reference clocks driving multiple transceiv- 
ers, as is common in prior art implementations. 
[0052] Although ensuring that the switch and all of its 
attendant transceiver circuits are bit and word synchro- 
45 nized, the synchronization method does require some 
means to ensure that both transmit and receive serial 
data streams contain sufficient signal edge transition 
density in order to maintain the established frequency 
lock. Given a preferred 15% edge transition density in 
50 a serial data stream, it will be understood that there need 
only be five transition edges incorporated in a 34-bit 
transmission character. Accordingly, only a few over- 
head bits are needed for each transmission character 
(word or frame) in order to maintain synchronization and 
55 frequency lock. Using this approach, the effective data 
bandwidth is reduced by only approximately 6%, as 
compared to a 20 to 40% bandwidth reduction in prior 
art systems. The higher bandwidth reduction is needed 
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in prior art systems in order to guarantee tinat the data 
signal contains a sufficiently liigh transition rate for fast 
phase recovery. 

[0053] As opposed to merely taking up transmission 

bandwidth, the overhead bits referred to above enable 
a particularly advantageous feature to be realized by the 
system. In contrast to the conventional prior art ap- 
proach, which required all transceiver port data trans- 
missions and connection requests to flow through a data 
bus to a single central control point, such as a control 
processor, the system implements flow control by 
changing the conventional meaning and function of the 
two overhead bits appended to the 32-bit data packet. 
The overhead bits appended to the 32-bit data packet 
are able to provide both low level flow control informa- 
tion and acknowledge and other information. The self- 
routing character switching and low level flow control ar- 
chitecture, as well as self-routing data switching, will 
now be described with reference to FIGS. 5a, 5b and 
FIG. 7. 

[0054] With particular reference to FIG. 7, there is 
shown a number of 34-bit transmission characters, as 
those characters would appear at the TXS transmit out- 
put and the RXS receiver input of the transceiver circuit 
68. A 34-bittransmission character including a 32-bit da- 
ta word, a command word, a connection request (CRQ), 
such as would be sent by the transceiver to its corre- 
sponding switch port, and a connection request reply, 
such as would be sent by a switch port back to its cor- 
responding transceiver are illustrated in FIG. 7. 
[0055] The data word format is the format of a data 
word as it would be seen on the serial data lines span- 
ning a transceiver and its corresponding switch port. 
The data word format is a 34-bit transmission character 
comprising a 32-bit data payload 110 and a 2-bit over- 
head field 112 appended thereto in the MSB positions. 
As was mentioned above, the 2-bit overhead field 112 
has a conventional usage, whereby if the overhead 
mode (OH-MODE) signal, coupled to the transmit con- 
trol circuit 71 and the receive control circuit 83, is in a 
first state, the overhead bits contained in the overhead 
field 112 identify the transmission signal's transmission 
type (TXTYP[1 :0]), as well as identifying the receive sig- 
nal's receive type (RXTYP[1 :0]). In contrast, when the 
overhead mode (OH-MODE) signal is in a second state, 
the bit content of the overhead bit field 1 1 2 contains flow 
control channel information which is time-shared with 
the signaling between the switch and a transceiver for 
acknowledgment and response bits. The main applica- 
tion for this flow control channel is to prevent the receive 
FIFO of the receiving transceiver port from overflowing 
and, by using this flow control channel when the receive 
FIFO is almost full, transmitting transceiver port will be 
disabled from sending further data. 
[0056] To provide self-routing and message passing 
functions, the transceiver and switch require different 
data types to differentiate between data words, connec- 
tion request words, message words or command words. 



Depending on the state of the OH-MODE signal, and 
thus the mode that the transceiver is in, different data 
types are recognized by the transceiver. These data 
types at the transceiver/FIFO parallel interface are en- 

5 coded in the TXTYP[1 :0] or RXTYP[1 :0] bits. The trans- 
mit control circuit 71 and receive control circuit 83 re- 
spectively encode these data types into the two over 
head bits B[1 :0] or decode the two overhead bits B[1 :0] 
for passage to the receive FIFO. 

10 [0057] The command word format, as seen on the se- 
rial data lines at the output of the transceiver or the 
switch, comprises a 2-bit overhead field 114 appended 
to a 32-bit string 1 1 6 at the MSB positions. The overhead 
field 114 comprises two overhead bits (0,0) which are 

15 added by the transceiver or switch to designate a com- 
mand word to the receiving switch or transceiver. The 
next three bit positions (from MSB to LSB) begin with a 
hard coded "1 ", followed by a pair of bits B[1 :0] that are 
encoded to define an alignment word, one of two flow 

20 control channels or an acknowledge signal or link initial- 
ization reset signal. An additional 5-bit field C[4:0] is re- 
served for defining a command type and is used to iden- 
tify alignment words, an IDLE signal, a RESET, signal, 
and the like. The command type field is followed by an 

25 optional 16-bit data payload field D[15:0], followed by 
an alternating pattern of "ones" and "zeros", terminating 
in a parity bit in the LSB position. 
[0058] A connection request (CRQ) command word 
format as seen at the transceiver-to-switch interface in- 

30 eludes an overhead bit field 118 appended to a 32-bit 
CRQ command word 120. The overhead bit field 118 
comprises two overhead bits that are added by the 
transceiver's transmit control circuit 71 in order to des- 
ignate either a CRQ word to the receiving switch, when 

35 the bits are configured (0,0) or to designate a header 
word for the next packet when the bits are configured 
(1,1). Similarly, a connection request as seen at the 
switch-to-transceiver interface includes an overhead 
field 122 appended to a CRQ command word 124. Two 

40 overhead bits are added by the switch in order to des- 
ignate a command word to the transceiver when the bits 
are configured (0,0). This word is provided by the switch 
to the receiving port, when an ACK signal is asserted to 
the transmitting port, and functions as start-of-packet. 

45 The switch-to-transceiver CRQ word format contains 
the current active connections for the transmitting port 
in a 16-bit active connection field C[15:0]. 
[0059] Thus, in accordance with the invention, a com- 
mand word can be used to send a connection request 

50 (CRQ) from a particular transceiver port to the switch 
matrix. An acknowledgment (ACK) to the request is re- 
turned from the switch to the requesting transceiver port 
by appending two overhead bits, configured (1 ,1 ) in ei- 
ther a command word's overhead field 114 or a data 

55 word's overhead field 112. Flow control channel infor- 
mation is also shared between a receiving transceiver 
port and a transmitting transceiver port by reconfiguring 
the two overhead bits comprising the overhead bit fields 
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1 1 2 and 11 4 of a data or command word. As will be de- 
scribed in greater detail below, a ready-to-received 
(RTR) configuration signal informs the transmitting 
transceiver port that there is sufficient room in the re- 
ceiving transceiver port's receive FIFO and that it is ap- 
propriate to continue to transmit data. A not-ready-to- 
receive (NRTR) signal informs the transmitting trans- 
ceiver port that the receiving transceiver port's receive 
FIFO is filling up and it is, therefore, not appropriate to 
continue sending data. 

[0060] A ready-to-receive (RTR) signal is generated 
by configuring the overhead bits as (0,1) while a not- 
ready-to-receive (NRTR) signal is generating by config- 
uring the overhead bits as (1 ,0). When the overhead bits 
are configured as (1,1), as indicated above, the over- 
head bits comprise an acknowledge (ACK) signal which 
is returned from the switch to a transceiver port which 
has made a connection request. It is the function of the 
switch, particularly the port logic 90 and arbitration logic 
and switch control circuit 55 to either generate the ap- 
propriate overhead bits (such as ACK) or to intercept 
flow control messages (such as RTR and NRTR) and 
re-direct them to the appropriate transceiver port so that 
effective flow control is maintained. 
[0061] In order to better understand the utility of the 
overhead bits, it will be useful to consider how flow con- 
trol overhead bits are generated by a transceiver in re- 
sponse to a FIFO almost full condition, and how flow 
control overhead bits are used in order to prevent further 
transmission. Referring now to FIGS. 5a and 5b, the re- 
ceive FIFO 66 is conventionally provided with a signal 
line that indicates that the FIFO is in an almost full con- 
dition. The receive FIFO 66 can overflow if data arrives 
and is written to the Fl FO faster than it can be read from 
the FIFO to the user's application circuit or physical me- 
dia. In the example of FIG. 5a, the almost full signal AF 
from the receive FIFO 66 is coupled to the transceiver's 
input register 70 which passes the AF signal to the trans- 
ceiver's transmit control circuit 71 . The AF signal will be 
asserted when the number of empty FIFO locations is 
less than or equal to a value pre-programmed into the 
FIFO. This minimum value typically depends on the la- 
tency period between the time when the AF signal is as- 
serted and when it is received at the transmitting trans- 
ceiver. The latency period is such that 14 + N more 
words are able to be transmitted, where N relates to a 
distance latency parameter and depends on the physi- 
cal distance between the transceivers and the switch. It 
will be understood by those having skill in the art how to 
calculate the number of words that might be written into 
an almost full FIFO during a latency period and how to 
program this value into the FIFO such that AF is assert- 
ed at the proper time. 

[0062] Transmit control circuit 71 receives the almost 
full indication and, if put into overhead mode by the ap- 
propriate OH-MODE signal, appends a not-ready-to-re- 
ceive (NRTR) signal to a command or data word. As 
mentioned above, an NRTR signal is generated by con- 



figuring the overhead bits as (1 ,0). The command or da- 
ta word including the NRTR signal is transmitted to the 
switch which recognizes the overhead bits as not com- 
prising a conventional pattern and, in response, strips 

5 the NRTR signal from the command or data word and 
routes it to the appropriate transceiver for action. The 
overhead bits are recognized by the switch port's port 
logic circuit 56 which directs them to the switch's arbi- 
tration logic and switch control circuit 55 through its par- 

10 allel bus connection through a plurality of 1 6 to 1 MUXes 
91 (only one of which is shown for clarity). The 16 to 1 
MUXes provide essentially the functions of a reverse 
cross-point switch, which is how the described function 
is implemented in one embodiment. Arbitration logic and 

15 switch control circuit 55 recognizes which of the 16 
switch ports provided the NRTR signal and, since it is in 
control of the configuration of the fabric 53, the arbitra- 
tion logic and switch control circuit 55 understands 
which of the 1 6 switch ports is coupled to the transceiver 

20 which is transmitting data to the almost full recipient. Ar- 
bitration logic and switch control circuit 55 then provides 
the NRTR signal (1,0) to the appropriate switch port's 
port logic circuit 56 through MUX 91 . That switch port's 
port logic circuit 56 appends the NRTR overhead bits to 

25 the next outgoing transmission to its corresponding 
transceiver 68. 

[0063] In the transceiver port circuitry 68, the (1,0) 
overhead bits are directed to the receive control circuitry 
83, as described above, which recognizes that the (1 ,0) 

30 overhead bit pattern represents a not-to-ready to re- 
ceive condition and that the transceiver should cease 
transmitting. Receive control circuit 83 communicates 
with transmit control logic circuit 71 over the internal 
communication bus 75 and passes the overhead signal 

35 values to the transmit control logic circuit for command 
processing. In transmit control circuit, the received flow 
control signal is ANDed with a read enable signal, con- 
trolled by the transmit control logic. The resulting read 
enable signal REN is connected through the input reg- 

40 ister 70 to the transmit FIFO 64. When a not-to-ready to 
receive signal is ANDed with read enable, the resulting 
REN signal is de-asserted, instructing the transmit FIFO 
64 that data reading is no longer enabled. Data trans- 
mission thereby ceases. Thus, the transceiver is only 

45 able to read a word from the transmit FIFO 64 if the flow 
control signal (the overhead bits) from the receiving 
transceiver are in a ready-to-receive (RTR) state. It 
should be noted, herein, that the switch is also able to 
independently assert and append an NRTR overhead 

50 pattern to any particular transmitting transceiver, in or- 
der to force an IDLE into the data stream to the trans- 
ceiver whenever needed. 

[0064] Turning now to FIG. 8, there is shown a semi- 
schematic block diagram of an embodiment of the flow 
55 control feedback mechanism in accordance with the 
present invention. 

[0065] In the embodiment of FIG. 8, information is be- 
ing simultaneously transmitted and received by three 
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transceiver port cards 130, 132 and 134, respectively 
indicated as port cards A, B and C, througli a switcli ma- 
trix unit 50. In the example, serial data streams are being 
transmitted by transceiver card A to transceiver card B; 
from transceiver card B to transceiver card C; and, from 
transceiver card C to transceiver card A. For purposes 
of tine example, it is assumed that the receive FIFO in 
transceiver card C is filling up. Accordingly, transceiver 
card C must have some means of signaling its data 
transmission partner, transceiver card B to temporarily 
cease transmitting data. Transceiver card C appends 
the overhead bits comprising the NRTR flow control 
code (1 ,0) to the 32-bit data packet comprising its next 
transmission to the switch matrix. The arbitration logic 
and switch control circuitry (55 of FIG. 5), in combination 
with the port logic circuitry (56 of FIG. 5) evaluates the 
overhead bits from transceiver card C and recognizes 
that transceiver card C wishes to alert its transmission 
partner that it is no longer ready to receive data. Since 
all of the current switch matrix connections are made 
through the switch control and port logic circuitry, the 
switch matrix is able to identify the current transmission 
partner of transceiver card C as transceiver card B and 
is able to re-direct the NRTR signal to transceiver card 
B by stripping the overhead bits from the transceiver 
card C transmission character and re-appending them 
to the next transmission character directed to transceiv- 
er card B, i.e., onto the data stream coming from trans- 
ceiver card A to transceiver card B. In this manner, trans- 
ceiver card B is made aware that its transmission part- 
ner, i.e., the intended recipient of its transmitted data, is 
no longer ready to receive transmission characters and 
transceiver card B must temporarily stop sending data. 
[0066] Using the overhead bits to provide flow control 
for data passing through the switch decreases utilization 
of the data bus used in conventional prior art-type im- 
plementations with a resulting increase in switch band- 
width. In addition, use of the round robin arbitration and 
switch control logic allows the data bus and processor 
of prior art implementations to be completely eliminated, 
along with the congestion associated with centralized 
control architecture. 

[0067] To summarize, the switch port's transmitter 

sends out data words that come from the switch matrix, 
adding the appropriate overhead bit information for ac- 
knowledges, response bits and flow control. Acknowl- 
edges are used to signal a corresponding transceiver 
that a connection request has been granted. Response 
bits are used with a Multi-Queue connection request 
word, which need not be considered further herein. The 
flow control channel is used to pass state information 
from the receiving transceiver port to the transmitting 
transceiver port. The switch redirects the flow control 
signals to the correct output using the current switch 
connection state information contained within an arbi- 
tration logic and switch control circuit. Thus, the self 
routing and flow control architecture in accordance with 
the present invention, enables a significant improve- 



ment in overall system bandwidth utilization and signif- 
icantly eases the task of the system designer in finding 
sufficient integrated circuit chip real estate to accommo- 
date the circuitry necessary to perform all the requisite 
5 tasks. 



Claims 

10 1. A high speed network switching apparatus, com- 
prising: 

a switch including: 

15 a plurality of switch ports (54), each switch 

port (54) adapted to transmit and receive a 
high-speed serial data stream; and 
a switch fabric (53) coupled to the plurality 
of switch ports (54), the switch fabric (53) 

20 routing data among and between the 

switch ports (54); 

a plurality of transceiver circuits (52), each 
transceiver circuit (52) configured to transmit 

25 and receive a h ig h speed serial data stream be- 

tween a corresponding one of the plurality of 
switch ports (54) so as to establish a transmis- 
sion channel between a corresponding trans- 
mitting transceiver circuit (68, TX) and a corre- 

30 spending receiving transceiver circuit (68, RX); 

wherein the data stream includes command 
and data words comprising: 

35 a data portion (110, 116, 120, 124); and 

a header portion (112, 114, 118, 1 22), charac- 
terised in tliat the header portion (112, 114, 
118, 122) includes overhead bits configured to 
provide a ready-to-receive indication (RTR) 

40 from a receiving transceiver circuit (68, RX) to 

a transmitting transceiver circuit (68, TX) when 
the overhead bits are in a first binary sequence, 
a not-ready-to-receive (NRTR) indication from 
a receiving transceiver (68, RX) to a transmit- 

45 ting transceiver (68, TX) when the overhead 

bits are in a second binary sequence, the switch 
adaptively routing the overhead bits from the 
corresponding receiving transceiver circuit (68, 
TX) to the corresponding transmitting receiver 

50 circuit (68, RX). 

2. The high speed network switching apparatus of 
claim 1 wherein the switch adaptively routes over- 
head bits from the corresponding receiving trans- 
55 ceiver circuit (68, RX) to the corresponding trans- 
mitting transceiver circuit (68, TX) using a reverse 
switch fabric. 
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3. The high speed network switching apparatus of 
claim 2 further comprising means for routing the 
overhead bits to the reverse switch fabric and for 
routing the data portion (110, 116, 120, 124) to the 
switch fabric (53). 5 

4. The high speed network switching apparatus of at 
least one of the preceding claims, further compris- 
ing a transmit data buffer (64, TXFIFO) coupled to 

the transceiver (68) over a parallel interface, the in- io 
terface defining at least an enable signal for ena- 
bling parallel data to be read to the transceiver (68, 
TX) when the signal is in a first state, and for disa- 
bling parallel data from being read to the transceiver 
(68) when the signal is in a second state. ^5 

5. The high speed network switching apparatus of at 
least one of the preceding claims, further compris- 
ing a receive data buffer (66, RXFIFO) coupled to 

the transceiver (68) over a parallel interface, the in- 20 
terface defining at least an indication signal when 
the data buffer is almost full. 

6. The high speed network switching apparatus of 
claim 5 further comprising means for appending an 25 
overhead bit field (110,116,1 20, 1 24) to a data or 
command word (110,116,1 20, 1 24), the overhead 

bit field (110, 116, 120, 124) containing overhead 
bits having a first configuration when the almost full 
indication signal is asserted, the overhead bits hav- 30 
ing a second configuration when the almost full in- 
dication signal is not asserted. 



Patentanspruche 

1. Schnelle Netzwerk-Switch-Vorrichtung, umfas- 
send: 

einen Switch, der folgendes enthalt: 

mehrere Switch-Ports (54), wobei jeder 
Switch-Port (54) so ausgelegt ist, daB er ei- 
nen schnellen seriellen Datenstrom sendet 
und empfangt; und 

ein an die mehreren Switch-Ports (54) an- 
gekoppeltes Koppelfeld (53), wobei das 
Koppelfeld (53) Daten unter und zwischen 
den Switch-Ports (54) routet; 

mehrere Sender-ZEmpfangerschaitungen 
(52), wobei jede Sender-ZEmpfangerschal- 
tung (52) so konfiguriert ist, da3 sie einen 
schnellen seriellen Datenstrom zwischen 
einem entsprechenden der mehreren 
Switch-Ports (54) sendet und empfangt, 
um so einen Ubertragungskanal zwischen 
einer entsprechenden sendenden Sen- 
der-/Empfangerschaltung (68, TX) und ei- 
ner entsprechenden empfangenden Sen- 
der-/Empfangerschaltung (68, RX) herzu- 
stellen; 

wobei der Datenstrom Befehls- und Datenworter 
enthalt, die folgendes umfassen: 



7. The high speed network switching apparatus of 
claim 5 or 6 further comprising means for reading 35 
an appended overhead bit field (110, 116, 120, 124), 

the means for reading asserting the read enable 
signal to the first, enable, state when the overhead 
bits are in the second configuration, and asserting 
the read enable signal to the second, disable, state 40 
when the overhead bits are in the first configuration. 

8. The high speed network switching apparatus of at 
least one of the preceding claims wherein the over- 
head bits transmitted by a particular switch transmit 45 
port to a particular transceiver indicate acknowledg- 
ment of receipt by the particular switch receive port 

of a request by the particular transceiver. 

9. The high speed network switching apparatus of at 50 
least one of the preceding claims wherein the over- 
head bits transmitted by a particular switch transmit 
port to a particular transceiver indicate the granting 

of a connection request requested by the particular 
transceiver. 55 



einen Datenteil (110, 116, 120, 124); und 
einen Kopfteil (112, 114, 118, 122), dadurch 
gekennzeichnet, daB der Kopfteil (112, 114, 
118,1 22) Overhead-Bit enthalt, die so konfigu- 
riert sind, daB sie folgendes bereitstellen: eine 
Empfangsbereitschaftsanzeige (RTR) von ei- 
ner empfangenden Sender-ZEmpfangerschal- 
tung (68, RX) zu einer sendenden Sender-/ 
Empfangerschaltung (68, TX), wenn sich die 
Overhead-Bit in einer ersten binaren Sequenz 
befinden, eine Nicht-Empfangsbereitschafts- 
anzeige (NRTR) von einem empfangenden 
Sender-ZEmpfanger (68, RX) zu einem senden- 
den Sender-ZEmpfanger (68, TX), wenn sich 
die Overhead-Bit in einer zweiten binaren Se- 
quenz befinden, wobei der Switch die Over- 
head-Bit aus der entsprechenden empfangen- 
den Sender-ZEmpfangerschaltung (68, TX) ad- 
aptiv zu der entsprechenden sendenden Sen- 
der-ZEmpfangerschaltung (68, RX) routet. 

2. Schnelle Netzwerk-Switch-Vorrichtung nach An- 
spruch 1 , wobei der Switch Overhead-Bit aus der 

entsprechenden empfangenden Sender-ZEmpfan- 
gerschaltung (68, RX) adaptiv zu der entsprechen- 
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den sendenden Sender-ZEmpfangerschaltung (68, 
TX) unter Verwendung eines umgekehrten Koppel- 
feldes routet. 

3. Schnelle Netzwerk-Switch-Vorrichtung nach An- 5 
spruch 2, weiterhin mit Mittein zum Routen der 
Overhead-Bit zu dem umgekehrten Koppelfeld und 
zum Routen des Datenteils (11 0, 11 6, 1 20, 1 24) zu 
dem Koppelfeld (53). 

10 

4. Schnelle Netzwerk-Switch-Vorrichtung nach min- 
destens einem der vorhergehenden Anspruche, 
weiterhin mit einem uber eine parallele Schnittstelle 
an den Sender-ZEmpfanger (68) angekoppelten 
Sendedatenpuffer (64, TXFIFO), wobei die Schnitt- 15 
stelle mindestens ein Freigabesignal zum Freige- 
ben des Auslesens paralleler Daten an den Sen- 
der-ZEmpfanger (68, TX), wenn sich das Signal in 
einem ersten Zustand befindet, und zum Sperren 
des Auslesens paralleler Daten an den Sender-Z 20 
Empfanger (68), wenn sich das Signal in einem 
zweiten Zustand befindet, definiert. 

5. Schnelle Netzwerk-Switch-Vorrichtung nach min- 
destens einem der vorhergehenden Anspruche, 25 
weiterhin mit einem uber eine parallele Schnittstelle 

an den Sender-ZEmpfanger (68) angekoppelten 
Empfangsdatenpuffer (66, RXFIFO), wobei die 
Schnittstelle mindenstens ein Anzeigesignal, wann 
der Datenpuffer fast voll ist, definiert. so 

6. Schnelle Netzwerk-Switch-Vorrichtung nach An- 
spruch 5, weiterhin mit Mittein zum Anhangen eines 
Overhead-Bit-Feldes (110, 116, 120, 124) an ein 
Daten- oder Befehlswort (110, 116, 120, 124), wo- 35 
bei das Overhead-Bit-Feld (110, 116, 120, 124) 
Overhead-Bit enthalt, die eine erste Konfiguration 
aufweisen, wenn das Fast-voll-Anzeigesignal ge- 
setzt ist, und die Overhead-Bit eine zweite Konfigu- 
ration aufweisen, wenn das Fast-voll-Anzeigesi- 40 
gnal nicht gesetzt ist. 

7. Schnelle Netzwerk-Switch-Vorrichtung nach An- 
spruch 5 Oder 6, weiterhin mit Mittein zum Lesen 
eines angehangten Overhead-Bit-Feldes (110,116, ^5 
120, 124), wobei die Mittel zum Lesen das Lesefrei- 
gabesignal in den ersten Freigabe-Zustand verset- 
zen, wenn sich die Overhead-Bit in der zweiten 
Konfiguration befinden, und das Lesefreigabesi- 
gnal in den zweiten Sperr-Zustand versetzen, wenn 50 
sich die Overhead-Bit in der ersten Konfiguration 
befinden. 

8. Schnelle Netzwerk-Switch-Vorrichtung nach min- 
destens einem der vorhergehenden Anspruche, 55 
wobei die durch einen bestimmten Switch-Sende- 
port zu einem bestimmten SenderZEmpfanger ge- 
sendeten Overhead-Bit bestatigen, daB der be- 



stimmte Switch-Empfangsport eine Anforderung 
des bestimmten SenderZEmpfangers empfangen 
hat. 

9. Schnelle Netzwerk-Switch-Vorrichtung nach min- 
destens einem der vorhergehenden Anspruche, 
wobei die durch einen bestimmten Switch-Sende- 
port zu einem bestimmten SenderZEmpfanger ge- 
sendeten Overhead-Bit die Gewahrung einer von 
dem bestimmten SenderZEmpfanger angeforderten 
Verbindungsanforderung anzeigen. 



Revendications 

1 . Appareil de commutation de reseau a grande Vites- 
se, comprenant : 

un commutateur comprenant : 

une pluralite de ports de commutation (54), 
chaque port de commutation (54) etant 
adapte pour transmettre et recevoir un flux 
de donnees serie a grande Vitesse ; et 
une matrice de commutation (53) couplee 
a la pluralite de ports de commutation (54), 
la matrice de commutation (53) achemi- 
nant des donnees au sein de et entre les 
ports de commutation (54) ; 
une pluralite de circuits d'emissionZrecep- 
tion (52), chaque circuit d'emissionZrecep- 
tion (52) etant configure pour transmettre 
et pour recevoir un flux de donnees serie 
a grande Vitesse avec I'un des ports de 
commutation correspondants de la plurali- 
te de ports de commutation (54), de manie- 
re a etablir un canal de transmission entre 
un circuit d'emission correspondant (68, 
TX) et un circuit de reception correspon- 
dant (68, RX) ; 

dans lequel le flux de donnees comprend des 
mots de commande et de donnees comprenant : 

une partiede donnees (110, 116, 120, 124) ; et 
une partie d'en-tete (112, 114, 118, 122), 

caracterise en ce que la partie d'en-tete 
(112, 114, 118, 122) comprend des bits d'en-tete 
configures pour transmettre une indication prete a 
recevoir (RTR) d'un circuit de reception (68, RX) a 
un circuit d'emission (68, TX) lorsque les bits d'en- 
tete sont dans une premiere sequence binaire, une 
indication non prete a recevoir (NRTR) d'un circuit 
de reception (68, RX) a un circuit d'emission (68, 
TX) lorsque les bits d'en-tete sont dans une secon- 
de sequence binaire, le commutateur acheminant 
de maniere adaptative les bits d'en-tete du circuit 
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de reception correspondant (68, TX) au circuit de 
transmission correspondant (68, RX). 

2. Apparel! de commutation de reseau a grande Vites- 
se salon la revendication 1 , dans lequel le commu- 5 
tateur achemine de maniere adaptative les bits 
d'en-tete du circuit de reception correspondant (68, 
RX) au circuit de transmission correspondant (68, 
TX) en utilisant une matrice de commutation inver- 
see. 10 

3. Appareil de commutation de reseau a grande Vites- 
se selon la revendication 2, comprenant en outre 
un moyen pour acheminer les bits d'en-tete jusqu'a 

la matrice de commutation inversee, et pour ache- 15 
miner la partie de donnees (110,116,1 20, 1 24) jus- 
qu'a la matrice de commutation (53). 

4. Appareil de commutation de reseau a grande Vites- 
se selon au moins Tune des revendications prece- 20 
dentes, comprenant en outre une memoire tampon 

de transmission de donnees (64, TXFIFO) couplee 
a I'emetteur/recepteur (68) sur une interface paral- 
lele, rinterface definissant au moins un signal de va- 
lidation destine a permettre aux donnees paralleles 25 
d'etre lues par I'emetteur/recepteur (68, TX) lorsque 
le signal est dans un premier etat, et destine a de- 
sactiver les donnees paralleles afin qu'elles ne 
soient plus lues par I'emetteur/recepteur (68) lors- 
que le signal est dans un second etat. so 



mier etat de validation lorsque les bits d'en-tete sont 
dans la seconde configuration, et confirmant le si- 
gnal de validation de lecture dans le second etat 
d'invalidation lorsque les bits d'en-tete sont dans la 
premiere configuration. 

Appareil de commutation de reseau a grande Vites- 
se selon au moins Tune des revendications prece- 
dentes, dans lequel les bits d'en-tete transmis par 
un port d'emission de commutation particulier vers 
un emetteur/recepteur particulier indiquent la con- 
firmation de reception par le port de reception de 
commutation particulier d'une requete effectuee par 
I'emetteur/recepteur particulier. 

Appareil de commutation de reseau a grande Vites- 
se selon au moins Tune des revendications prece- 
dentes, dans lequel les bits d'en-tete transmis par 
un port d'emission de commutation particulier vers 
un emetteur/recepteur particulier indiquent I'octroi 
d'une demande de connexion effectuee par I'emet- 
teur/recepteur particulier. 



5. Appareil de commutation de reseau a grande Vites- 
se selon au moins I'une des revendications prece- 
dentes, comprenant en outre une memoire tampon 

de reception de donnees (66, RXFIFO) couplee a 35 
I'emetteur/recepteur (68) sur une interface paralle- 
le, rinterface definissant au moins un signal d'indi- 
cation lorsque la memoire tampon est presque plei- 
ne. 

40 

6. Appareil de commutation de reseau a grande Vites- 
se selon la revendication 5, comprenant en outre 
un moyen pour joindre un champ de bits d'en-tete 
(110, 116, 120, 124) a un mot de donnees ou de 
commande (110, 116, 120, 124), le champ de bits 45 
d'en-tete (110, 116, 120, 124) contenant des bits 
d'en-tete possedant une premiere configuration 
lorsque le signal d'indication de memoire presque 
pleine est confirme, et les bits d'en-tete possedant 
une seconde configuration lorsque le signal d'indi- 50 
cation de memoire presque pleine n'est pas confir- 
me. 



7. Appareil de commutation de reseau a grande Vites- 
se selon la revendication 5 ou 6, comprenant en 55 
outre un moyen pour lire un champ de bits d'en-tete 
joint (1 1 0, 1 1 6, 1 20, 1 24), le moyen de lecture con- 
firmant le signal de validation de lecture dans le pre- 
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